DOCUMENT RESUME 



ED 444 824 SE 063 755 



AUTHOR 

TITLE 


Dunson, Marlies A. 

From Research to Practice and Back Again: TIMSS as a Tool 
for Educational Improvement. CPRE Policy Briefs. 


INSTITUTION 


Consortium for Policy Research in Education, Philadelphia, 
PA. 


SPONS AGENCY 


National Inst, on Educational Governance, Finance, 
Policymaking, and Management (ED/OERI) , Washington, DC.; 
Office of Educational Research and Improvement (ED) , 
Washington, DC. Office of Reform Assistance and 
Dissemination. 


REPORT NO 
PUB DATE 
NOTE 

CONTRACT 
AVAILABLE FROM 


RB-30 

2000-04-00 

14p. 

R215U980021 

CPRE, University of Pennsylvania, Graduate School of 
Education, 3440 Market Street, Suite 560, Philadelphia, PA 
19104-3325. 


PUB TYPE 
EDRS PRICE 
DESCRIPTORS 


Reports - Descriptive (141) 

MFOl/PCOl Plus Postage. 

♦Educational Change; *Educational Improvement; Elementary 
Secondary Education; Mathematics Education; Science 
Education; *Teaching Methods 


IDENTIFIERS 


♦Third International Mathematics and Science Study 


ABSTRACT 




Education (CPRE) 


Founded in 1985, the Consortium for Policy Research in 
studies alternative approaches to education reform in order 



to determine how state and local policies can promote student learning. This 
issue of CPRE Policy Briefs focuses on the Third International Mathematics 
and Science Study (TIMSS) . (ASK) 



Reproductions supplied by EDRS are the best that can be made 
from the original document. 






From Research to Practice 
and Back Again 
TIMSS as a Tool for 
Educational Improvement 



by 

Harlies A. Dunson 



U.S. DEPARTMENT OF EDUCATION 
Office of Educational Research and Improvement 

EDUCATIONAL RESOURCES INFORMATION 
CENTER (ERIC) 

□ This document has been reproduced as 
received from the person or organization 
originating it. 

□ Minor changes have been made to 
improve reproduction quality. 



® Points of view or opinions stated in this 
document do not necessarily represent 
official OERI position or policy. 




2 






Graduate School of Education • University of Pennsylvania • RB-30-April 2000 



From IReseareCu FraeSoc© 
TIMSS as aT@@ll f@r Edlyeaft 

by [Vilarlies A. Duosoo 



Y I I ^he U.S. Department of Education released data 
from the Third International Mathematics and Sci- 
ence Study (TIMSS) to serve as a “starting 
point to examine U.S. education, student achieve- 
ment, teaching and curricula.”' The researchers and admin- 
istrators ofTIMSS hoped that these findings would provoke 
reflective discussions by providing a different lens through 
which schools could reevaluate their current practices and 
education policymakers could benefit from new insights. In 
the three years following the release of the first set of data, a 
number of states, districts, and schools have delved deeply 
into TIMSS for policy development and school improvement, 
receiving assistance through meaningful collaborations. U.S. 
researchers, practitioners, and policymakers have been work- 
ing together with data from TIMSS and other research stud- 
ies to generate viable solutions for improving student achieve- 
ment in mathematics and science. 



This Policy Brief stems from one such effort — a TIMSS 
Policy Fomm that was held in Washington, D.C. in 1 999. At 
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the Forum, researchers described the questions they were 
seeking to answer using TIMSS data, and practitioners and 
state and local policymakers described the tactics they were 
taking to support school improvement using those research 
findings. The interdependence among research, policy, and 
practice demonstrated at the Forum and reported in this Brief 
serves as a model for a national conversation on education 
that is grounded in both information and its practical applica- 
tion. 

The initiatives, outlined below, undertaken in the three dis- 
tricts, one school, and one state illustrate the impact that mean- 
ingful data and useful interpretations of those data can have 
on education policy and practice. By closely comparing and 
contrasting the curricula, teaching practices, professional de- 
velopment, and administration policies of many countries, re- 
searchers, policymakers, and practitioners can jointly assess 
what might work best for students in the United States. 



The Consortium for Policy Research in Education (CPRE) studies alternative approaches to education reform in order to 
determine how state and local policies can promote student learning. Currently, CPRE’s work is focusirxg on accountability 
policies, effort.s to build capacity at various levels within the education system, methods of allocating resources and compensat- 
ing teachers, and governance changes like charters and mayoral takeover. The results of this research are shared with 
policymakers, educators, and other interested individuals and organizations in order to promote improvements in policy design 
and implementation. CPRE is supported by the National Institute on Educational Governance, Finance, Policymaking and 
Management, Office of Educational Research and Improvement, U.S. Department of Education. 
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Practitioners’ 



Efforts to Use TIM 




How do the social and cultural contexts differ between 
Consortium schools and countries around the world?^ 



First in the World Consortium 

The First in the World Consortium grew out of the conversa- 
tions of a study ^oup of superintendents who initially met to 
fulfill a requirement for recertification. After meeting sev- 
eral more times, they decided to form a consortium that fo- 
cused on Goal 5 of the National Education Goals: To be the 
first in the world in math and science by the year 2000. In 
this effort, First in the World — which unites 18 school dis- 
tricts in the suburbs surrounding Chicago, Illinois — received 
permission to participate in the TIMSS as a self-contained 
unit in order to benchmark the performance of its schools 
against international measures of student performance. 

Leaders of First in the World obtained technical, administra- 
tive, and research support from partnerships established with 
the business community and with key education organiza- 
tions, such as the U.S. Department of Education and the 
North Central Regional Educational Laboratory. With that 
support. First in the World created “learner networks” so 
teachers, principals, and superintendents could study and dis- 
cuss important issues like performance expectations, instmc- 
tional practices, teacher characteristics, technology, assess- 
ment, and the stmcture and content of curricula. The discus- 
sions stemmed from 13 research questions, four of which 
follow: 

• Do school programs in the Consortium reflect a “world- 
class” curriculum? 

• What instructional practices in the Consortium make a 
difference in student achievement? 

• Does curriculum in Consortium schools “fit” with inter- 
national standards? 



To answer these and other research questions. First in the 
World began the following initiatives: 1 ) producing a curricu- 
lum analysis for each district, which compares the district to 
the highest achieving countries in the world and which pro- 
vides guidelines for four areas of local analysis leading to 
improvements; 2) developing a comprehensive mathematics 
and science curriculum framework for K-8 that supplies a 
sequence of mathematics and science content standards and 
performance expectations;’ 3) reporting on the research ques- 
tions, including the data sources, methodology, findings/re- 
sults, and implications for school districts; 4) participating in 
the TIMSS-R videotape study in both mathematics and sci- 
ence instruction at the eighth grade level; and 5) developing 
“Lesson Study Groups” at the Consortium level as well as 
the local district level. 

The Consortium leadership recognized early on the unique 
nature of the 1 8 school districts. It also accepted the fact that 
each district individually would be addressing priorities and 
devoting resources and energy to accomplish those distinc- 
tive priorities. Therefore, it was determined from the start 
that all of the Consortium findings would be processed and 
implemented by each district within its own culture and in its 
own timing. 

With that consideration, each of the five initiatives has raised 
the overall discussion about curriculum and instruction to a 
new level. “Comparisons at the international level and deep 
discussion about the focus, rigor, and flow of what we teach 
in addition to how we must raise the level of teaching has 
radically improved over the past three years,” explained David 
Kroeze, Superintendent of Schools for the Northbrook School 
District #27 (Illinois). He continued, “The Consortium has 
successfully institutionalized the need to look outside our en- 
vironment for ways to challenge our assumptions of ‘effec- 
tive practice.’” 



About CPRE Policy Briefs 

CPRE Policy Briefs are published by the Consortium for Policy Research in Education (CPRE). The research 
reported in this issue was supported by a grant (No. R2 1 5U98002 1 ) from the Fund for Improvement of Education, 
Office of Reform Assistance and Dissemination, Office of Educational Research and Improvement, U.S. Department 
of Education. The views expressed in this publication are those of its author and are not necessarily shared by 
the U.S. Department of Education, the Office of Educational Research and Improvement. CPRE. or its institu- 
tional members. 
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The results of the TIMSS curriculum analysis reinforced prior 
research findings and strengthened First in the World’s com- 
mitment to aligning curricula. The TIMSS results showed that, 
in spite of variable achievement scores, the U.S. curricula 
contain the largest variety of topics, and those topics tend to 
be repeated in more grades than in any other country. For 
example, researchers found that in the eighth grade, 38 top- 
ics were covered in U.S. mathematics textbooks, while an 
average of 23 topics were taught eighth grade textbooks in 
other countries."' Yet, U.S. students had not received in-depth 
instruction in many concepts that TIMSS tested. According 
to TIMSS findings, the “basics” in the U.S. eighth grade math 
curriculum was quite different from the basics in other coun- 
tries’ programs.^ 

But it is not just the TIMSS findings on curricula that con- 
tinue to influence the efforts of First in the World. Paul 
Kimmelman, Superintendent of Schools for the West 
Northfield School District #3 1 (Illinois), wrote, “. . .TIMSS 
enables us to analyze each district’s mathematics and sci- 
ence curriculum, compare instructional strategies of teach- 
ers in the United States, Germany, and Japan and learn what 
our students actually think about their behaviors in our 
schools.”* 

The SMAIRT Coosoirtflyirini 

As public awareness and political pressure grew in Ohio over 
the results ofTIMSS and other achievement measures, the 
Ohio legislature passed a school accountability law, which 
set minimum standards for school district performance and 
increased the rigor of Ohio’s high school exit exams and 
graduation requirements. As part of its statewide strategies 
to improve mathematics and science, in March 1998 the staff 
at the Ohio Department of Education assembled a group of 
superintendents in the Cleveland area whose districts would 
comprise the Science and Mathematics Achievement Re- 
quired for Tomorrow (SMART) Consortium. This Consor- 
tium, supported by the Ohio Department of Education and 
the Martha Holden Jennings Foundation, unites 19 school dis- 
tricts in northeast Ohio through the efforts of 1 9 superinten- 
dents. Combined, the districts serve more than 200,000 stu- 
dents from large urban areas such as Cleveland Municipal, 
affluent suburbs like Beachwood, and small rural towns like 
Kirtland Local. 

The members of the SMART Consortium have committed to 
long-term systemic change and continuous improvement in 
mathematics and science by employing five big-picture strat- 
egies based on recommendations from action teams that stud- 
O ’ lie issues: 




° Providing alignment in curriculum, instruction, assess- 
ment, and professional development using world class 
standards as a guide; 

■> Affecting the willingness of teachers and administrators 

to bring about change; 

° Changing people’s beliefs about the nature of learning; 

° Developing and maintaining buy-in and support from the 

public, parents, students, school boards, business, indus- 
try, and the community; and 

° Improving teaching and learning district by district using 

research-based education techniques. 

SMART hopes to reach two “stretch goals,” which were set 
forth by its member districts after several months of debate. 
The first goal is for districts to cut their student failure rate 
on state proficiency tests in half over the next five years. 
While the heterogeneity of the districts leads to the conclu- 
sion that they have different needs with respect to the achieve- 
ment goal, the collaborative nature of the Consortium is re- 
sulting in joint efforts among districts, such as the develop- 
ment of a common course of study that will be implemented 
across the Consortium. Districts have realized that the im- 
provement of public education is something that will not hap- 
pen if districts, schools, and teachers continue to work in 
isolation. By working together, the expertise provided by each 
district can be used to the fullest. 

The second stretch goal deals with the districts’ capacity to 
provide for increased student achievement through its re- 
sources. This goal has several sub-goals that lay out pro- 
gram requirements for mathematics and science in elemen- 
tary, middle, and high school: 

° All school districts will require completion of elementary 

mathematics by the end of grade five; 

° All school districts will require completion of an algebra 

I core by the end of eighth grade; 

° All school districts will require completion of algebra II 
and geometry for graduation; 

° All school districts will require completion of elementary 

science by the end of grade four; 
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• All school districts will require completion ofan integrated 
core of life, earth/space, and physical science by the end 
of eighth grade; and 

• All school districts will require completion of physics, 
chemistry, earth/space, and biological sciences for gradu- 
ation. 

Each district will create an action plan that lays out the steps 
needed in that district to reach the stretch goals. These indi- 
vidual action plans will be used to determine how the collec- 
tive resources of SMART can be used best. 

Meanwhile, many efforts are currently underway to help 
teachers achieve the stretch goals. These include pilot imple- 
mentation projects of new science instructional materials in 
the upper elementary grades, a pilot of a content-based pro- 
fessional development series for mathematics teachers in 
grades five through eight, the development of teacher learn- 
ing networks, and the implementation of a principals’ acad- 
emy to provide better expertise in instructional leadership at 
the building level. As the districts formulate more detailed 
plans that will facilitate the achievement of the stretch goals, 
Consortium-level activities may shift in focus. 

While the TIMSS provided the impetus for the formation of 
the SMART Consortium, the group continues to learn from 
the TIMSS findings as they conduct their activities. This is 
especially evident in the deliberations of the course of study 
committees, which are attempting to provide a focused cur- 
riculum to combat the “mile wide, inch deep” characteristic 
that permeates American curricula. Eighth graders took the 
TIMSS-R in spring 1999, and the Consortium will analyze 
the data in the spring of 200 1 . Finally, the Consortium is using 
the findings of The Teaching Gap by James W. Stigler and 
James Hiebert(1999) to investigate how the teacher learn- 
ing networks can improve instruction. 

The Regional Math/Science Collaborative 

Two major beliefs led to the creation of the Regional Math/ 
Science Collaborative in 1994: “a mathematically and scien- 
tifically literate population is essential to the social and eco- 
nomic success of southwestern Pennsylvania” and “by work- 
ing together, we can do better.”’ The Collaborative, located 
in southwestern Pennsylvania, unites 100+ school districts, 
approximately 15,000 mathematics and science educators, 
and hundreds of interested stakeholders, such as corpora- 
tions, museums, foundations, and universities. 



Determining what mathematics and science instruction cur- 
rently looks like in the region, what it should look like, and 
how to bridge that gap formed the blueprint for the initiative. 
Once the answers to the first two questions were agreed 
upon by task forces, the Collaborative chose to 1 ) communi- 
cate the information through conferences, publications called 
the Journal and Coordi-net, and a continually updated web 
site;® 2) facilitate planning by conducting review sessions and 
preparing testimony on state standards; and 3) measure 
progress by gathering and evaluating achievement data. 

Additionally, members of the Collaborative developed a re- 
source binder titled Making National Standards and TIMSS 
Work for Our Region. The binder helps teachers and ad- 
ministrators combine the results ofTIMSS with the National 
Science Education Standards and the National Council of 
Teachers of Mathematics standards so they can develop dis- 
trict-level action plans for curriculum and professional devel- 
opment. Many of the goals for students in the Collaborative’s 
vision statement respond to TIMSS research findings on in- 
structional practice. For example, students in the Collabora- 
tive will: 

• Demonstrate problem-solving and critical thinking skills, 
requiring both team and individual effort and responsibil- 
ity, 

• Apply knowledge as well as its reproduction; and 

• Engage in disciplined inquiry including an in-depth under- 
standing of a problem and the integration of newly ac- 
quired information with the student’s prior knowledge.’ 

The teacher questionnaire component of the TIMSS produced 
many findings that the Collaborative took into consideration. 
For instance, in the questionnaire, teachers were asked if 
they view mathematics and science as a 1) discipline with 
canons and formal processes; 2) set of procedures; or 3) 
process or way of thinking. Most U.S. teachers identify math- 
ematics and science as a set of procedures first and fore- 
most. By contrast, Japanese teachers more often see math- 
ematics as a set of relationships between concepts, facts, 
and procedures and think mathematics is inherently interest- 
ing. 

At the Forum, James Hiebert, an education professor at the 
University of Delaware and Co-Director for the videotape 
study, shared some of the results fi'om the video component 
of the TIMSS. While examining 23 1 hours of videotapes of 
eighth grade mathematics classrooms in Japan, the United 
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States, and Germany, researchers focused on teachers’ goals 
for the lesson, whether mathematical concepts were “devel- 
oped” or “stated” in the lessons, and the kind of reasoning 
required of the students during the lessons. Four university 
mathematics teachers assisted in judging the quality of the 
mathematics content of the lessons. 

One important conclusion was that teaching methods are 
consistent with teachers’ goals, which vary significantly across 
countries. For example, the goal ofmany U.S. teachers is to 
help students master mathematical procedures. In the typical 
mathematics lesson captured by the TIMSS, the U.S. teacher 
merely states the concept, demonstrates how to work the 
problems, and asks the students to practice the procedure on 
similar problems. Little time is spent developing connections 
and relationships between ideas; the focus is on practicing 
procedures (see Figures 1 and 2). 

Teachers in the Regional Math/Science Collaborative have 
used these findings to reflect on their own practices, to set 
priorities, and to make connections. Some “Core Leadership 
Teams” within the Collaborative have formed study groups 
to view and discuss the video case studies. Others have es- 
tablished school visitations and peer coaching to observe tech- 
niques and instructional strategies. 

Lynn Liptak, the principal of Paterson School #2 in Paterson, 
New Jersey drew on TIMSS findings to improve instruction 
and professional development at her elementary/middle school 
in which 98 percent of the students are eligible for fi-ee lunch. 
“We saw TIMSS as something we could use at the class- 
room level,” said Liptak, “We saw it as a vehicle to tackle 
fimdamental problems.” 



Initially, Liptak and two teachers at the school. Bill Jackson 
and Beverly Piekema, viewed the TIMSS videotapes and 
studied the findings. With that information, Jackson and 
Piekema began writing their own curriculum, modeling it on 
the Japanese style with the help of colleagues over a two- 
year period. They also redesigned their teaching methods. 
For example, Jackson now poses a thought-provoking prob- 
lem that his students stmggle with before they present pos- 
sible solutions. The class discusses the solutions and Jackson 
uses their conclusions to instmct the class. He summarizes 
the lesson, relating it back to the original problem, and as- 
signs students similar problems to practice. 

To provide students with a concrete demonstration of what 
he wants when he asked them to present solutions, Jackson 
had his students watch and evaluate the TIMSS videotapes. 
“1 thought it was very important for students to understand 
what 1 was attempting to do,” said Jackson. “1 [also] wanted 
to know what they thought of the TIMSS tapes (for example. 
Which lessons did they like better? Which looked like more 
fun? In which one did it look like they were learning?).” 

When Jackson’s students prepared to write lessons and teach 
younger students as part of a school project, he had them 
watch the TIMSS videotapes again. Jackson felt this experi- 
ence sealed some of the ideas in their heads. “Some students 
[after leaving Paterson] have even given suggestions to their 
high school teachers on how to teach better!” said Jackson. 

Hiebert cited additional benefits ofthe TIMSS videotape study 
at the Fomm, saying it provides concrete examples to anchor 
discussions in teaching practice, a range of alternative prac- 
tices with which to compare the U.S. system, and the sup- 
port of rich data through multiple forms of analyses to test 
hypotheses. Hiebert warned, however, that teaching prac- 
tices are part of an education system and, too often, unsuc- 
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Box 1 

ProfessIoiiaS Development 



Traditional 

• Begins with an answer. 

• Driven by the expert trainer. 

• Communication flow is from trainer to participants. 

• Relationships are (tacitly) hierarchial. 

• Research informs practice. 



Practical Inquiry 

• Begins with a question. 

• Driven by the participants. 

• Communication flow is conversation among participants. 

• Relationships are reciprocal. 

• Practice is research. 



Source: PowerPoint presentation by Lynn Liptak. http://www.tc.columbia.edu/ceoi/eli Slide #27. 



cessful attempts to improve the U.S. education system stem 
from adopting another country’s methods piecemeal. Importing 
whole systems doesn’t work either, he explained, because 
systems of education are embedded in a country’s culture. 
Liptak offered a similar conclusion based on her school’s 
experiences saying, “This is not a panacea. The problems 
are systemic and fundamental, so the changes must be sys- 
temic and fundamental.” 

For professional development at Paterson School #2, Liptak 
formed a voluntary, weekly mathematics study group that 
gave teachers time to explore ideas in math, to discuss cur- 
rent research, to plan lessons cooperatively, and to observe 
one another’s teaching. Liptak explained, “If teachers are to 
teach in more powerful ways, they must have the opportu- 
nity to learn in more powerful ways.” 

The mathematics study group engaged in “practical inquiry” 
professional development. Unlike traditional professional de- 
velopment, practical inquiry begins with a question that teach- 
ers and principals explore together, tapping outside informa- 
tion, but also constructing knowledge from their own stu- 
dents and practice. (See Box 1 for the contrast between tra- 
ditional and practical inquiry professional development as 
viewed by Liptak.) 

The most recent form of practical inquiry that Paterson School 
#2 is engaged in is the “lesson study,” which aims to improve 
teaching and learning in whole systems. Paterson is working 
closely with the Greenwich Japanese School, a school run by 
the Japanese government for expatriates in the United States, 
to learn how to run a lesson study. Unlike the United States, 
Japanese teachers run their own professional development 
programs, which focus on these lesson studies. Catherine 
Lewis, a professor at Mills College who studied teachers in 
-=;xplained at the TIMSS Forum that lesson studies or 




“research lessons” are actual classroom lessons that are care- 
fully planned, usually in collaboration with other teachers. 
Teachers identify a schoolwide theme, such as “developing 
initiative,” and create, conduct, and evaluate lessons. The 
lesson is taught by one of the teachers and observed and 
discussed by other teachers to determine its strengths and 
weaknesses. Research lessons spread ideas for new content 
material and approaches, connect classroom practice to 
broader goals and policies, and help teachers learn about how 
students learn. 

TIMSS Research Projects 

Several education researchers presented their ongoing work 
and future plans at the Policy Forum in Washington, D.C., 
including the projects listed below. 

University of Pennsylvania and 
Pennsylvania State University Project 

How can the science and mathematics achievement of Ameri- 
can fourth, eighth, and twelfth grade students in international 
comparisons be explained? To answer this, professors from 
the University of Pennsylvania and Pennsylvania State Uni- 
versity received conjoint grant funding from the U.S. De- 
partment of Education and the National Science Foundation 
to: a) analyze TIMSS data to identify factors that contribute 
to academic achievement in mathematics and science; and 
b) to disseminate the policy implications of their findings." 
The major components of the project include augmenting 
TIMSS by collecting additional national-level variables, per- 
forming secondary analyses of the augmented TIMSS data, 
and convening three annual TIMSS Policy Forums to dis- 
seminate and discuss TIMSS research findings. 
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CoyocDl of Chief Sfafe School Officers Projecf 

The Council of Chief State School Officers (CCSSO) under 
a grant fi'om the National Science Foundation is conducting a 
study of state reform and systemic initiatives in mathematics 
and science. The study focuses on curriculum content and 
teaching practices in 1 1 states and compares those findings 
to state standards and initiatives. CCSSO uses TIMSS and 
NAEP data to pinpoint educational practices related to im- 
proved student performance. 

Bostoo Colllege Projecf 

A1 Beaton, the Director of the Center for the Study of Test- 
ing, Evaluation, and Educational Policy located at Boston 
College, received a three-year grant from the National Sci- 
ence Foundation to work with a statistical model to examine 
the importance of students’ socioeconomic status versus the 
effects of schools. The statistical model enables Beaton to 
look at mathematics achievement at the school and class- 
room levels and to separate student background from school 
variables. 

TIMSS CuirirDCUIum Dafa Pirojecf 

william Schmidt, Professor and Executive Director of the 
U.S. National Research Center on the TIMSS at Michigan 
State University, is conducting research on how much cur- 
riculum variables affect student achievement. 

Stieps aDid ti[hieTiySS=lR 
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TICiSS^lR SM® aiDTdl OosUiTDdl 
BeoiclhimairGciBig ParHicopaiinitls 

° Connecticut 
° Idaho 
° Illinois 
° Indiana 
° Maryland 
° Massachusetts 
° Michigan 
° Missouri 
° North Carolina 
° Oregon 
° Pennsylvania 
° South Carolina 
° Texas 

° Academy of School District #20 (CO) 

° Chicago Public Schools (IL) 

° Connected Mathematics Project (MI) 

° Delaware Science Coalition 
° First in the World Consortium (IL) 

° Fremont/LincolnAVest Side Public Schools (NE) 
° Guilford County Schools (NC) 

° Jersey City Public Schools (NJ) 

° Miami-Dade County Public Schools (FL) 

° Montgomery County Public Schools (MD) 

° Naperville School District #203 (IL) 

° Regional Math and Science Collaborative (PA) 

° Rochester City School District (NY) 

° SMART Consortium (OH) 



This section of the Brief looks to the future and discusses 
how researchers and practitioners will be using the follow-up 
study to TIMSS — ^TIMSS-R or the Third International Math- 
ematics and Science Study-Repeat — to further examine and 
possibly alter U.S. education policy and practice for the ad- 
vancement of student learning. Focusing on eighth grade 
mathematics and science, the TIMSS-R replicates three com- 
ponents of the TIMSS: 1) the student assessment and back- 
ground questionnaires for students and teachers; 2) the state 
and district benchmarking study; and 3) the videotape study. 
Currently, Australia, the Czech Republic, Hong Kong, Japan, 
Luxembourg, the Netherlands, Switzerland, and the United 
States are participating in the TIMSS-R video study. 

TIMSS-R in its entirety enables researchers, practitioners, 
and policymakers to monitor trends in student achievement 
and to track four years later the progress of those students 
who took the TIMSS in the fourth grade. It collects more 

O 



background information, such as professional development 
and teaching practice, as well as new data on countries, 
states, and districts that did not participate in TIMSS. 

Mossoimrl 

Like many other states and districts (see Box 2), Missouri 
is participating in the TIMSS-R benchmarking study to see 
how the state compares on acliievemenl scores to the 
United States and other countries. Missouri participated in 
TIMSS originally to verify the accuracy of the state test 
titled the Missouri Assessment Program (MAP). James 
Friedebach, the Director of Assessment, said that when 
Missouri state education administrators linked the TIMSS 
with the MAP, they found that student achievement in cer- 
tain mathematics and science topics — specifically geom- 
etry, measurement, and physics — ^needed and subsequently 
received attention. 



Box 3 




TIMSS-R 

December 2000-January 2001 — International and U.S. 
results. 

TIMSS-R State and District Benchmarking Study- 
May 200 1 — Benchmarking reports. 

September 200 1 — ^Benchmarking database. 

TIMSS-R Videotape Study 

August 200 1 — Report on mathematics teaching practices. 
August 2002 — Report on science teaching practices. 

Contact Information 

National Center for Education Statistics (202) 219-1 828 
Boston College (6 1 7) 552- 1 600 



The combination of the MAP and TIMSS helped launch two 
new initiatives: a mathematics initiative to build capacity across 
the state and a science initiative to improve student perfor- 
mance. Missouri also made use of the TIMSS data as part of 
“Interface Conferences” in which mathematics and science 
teachers from around the state met to discuss problems and 
solutions. TIMSS is now officially one of the Missouri De- 
partment of Education’s strategic planning indicators. 

Like Missouri, First in the World plans to participate in TIMSS- 
R benchmarking study and will test the same seventh grade 
students who took the TIMSS in the fourth grade. First in the 
World also will participate in the TIMSS-R video study, as 
previously mentioned, but by taking a different approach. It 
will take two of the most difficult math and science lessons 
and compare them with the instructional practices of other 
leading countries. As part of the TIMSS-R video study, inter- 
views will be conducted with teachers before and after les- 
sons and with students after lessons. Multiple lessons over 
days will be conducted to follow the progression of the in- 
struction, and these lessons will be compared with interna- 
tional counterparts. 



In the final remarks of the 1 999 TIMSS Forum in Washing- 
ton, D.C., Richard Elmore, Co-Director of CPRE and a pro- 
fessor at Harvard University, suggested that TIMSS is a 
benchmark, a tool for improvement, and a public good. 
The importance of TIMSS as a benchmark, Elmore asserted, 
will grow as other measures of accountability are allotted 
higher stakes. TIMSS can be used as a point of departure for 
education practitioners, administrators, and policymakers to 
ask themselves if their estimation of students’ and schools’ 
performance is correct and, as with Missouri, TIMSS-R surely 
will facilitate this process. 

The district initiatives and Paterson School #2 demonstrate 
the power of TIMSS as a tool for improvement, even without 
formally participating in the study. The videotape portion alone 
enables practitioners to see what researchers can otherwise 
only explain in the abstract. 

Finally, commenting on TIMSS as a public good, Elmore said, 
“TIMSS has given the policy community a new way to think 
about recurring problems.” Perhaps most important, TIMSS 
connects researchers and practitioners and gives the country 
both the impetus and the opportunity to engage in a large- 
scale, public debate about education that is objective and in- 
formed. 
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